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CONCEPTUALIZING AND VALIDATING TEACHER QUESTIONING SKILLS 


Abstract 


Questioning Is a communicative skill that plays an Integral role In 
effective instruction. While a number of articles and texts offer advise about 
questioning, the benef its of specific questioning techniques are often assumed, 
not established. The Importance of val idating specific questioning techniques 
before Including them In tralning programs Is evident. This paper develops a 
conceptual ization of the Interactional components of the questioning process, 
and reviews research evaluating the benefits of alternative questioning 


techniques. 
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CONCEPTUALIZING AND VALIDATING TEACHER QUESTIONING SKILLS 


Scholars fran a variety of disciplines recognize that competent 
questioning skil Ils are an Important component of effective Instruction. Cooper 
(1981) notes that "All teachers, regardl ess of thelr subject area, must expl alin 
concepts, establ Ish human relationships, ask and answer questions, resolve 
conflicts, and |ead discussions, all of which Involve communication skIils" (p. 
224). The conclusions of two recent reviews of questioning research highl Ight 
the Importance of the communicative skills Involved In teacher questioning. 
Wilen (1982) argues, "Since communication Is an essential of teaching, and 
questioning [Is an Integral part of classroan verbal Interaction, to a 
substantial degree teacher effectiveness Is affected by questioning skIlI" (p. 
25). Lange (1982) writes, "The basic | anguage of the classroan Is a dichotomy 
of teachhers' questions and students’ responses. When considered In this way, 
we reallze that any lack of success In classroan situations Is probably the 
result of Inattention to the questlon-response cycle and Its content" (p. 180). 

Questioning skills are considered Important because of thelr presumed 
relationship to a number of Important educational outcomes. The two most 
frequently studied outcomes have been students’ achievement and critical 
thinking sklils (Gall, 1984). The significance of both these variables Is well 
establ Ished. Under achievement has been defined as an Individua!l's fallure to 
master skills they have the capacity to learn (Carrol, 1963). Thought of In 
this light, an Instructional technique which results In Improved student 
achievement reduces the amount of wasted student capability. Additionally, 
Instructional techniques which result In Improved achievement have also usual ly 
Improved students! attitudes toward school (Medley, 1979). The devel opment of 


critical thinking skills has often been thought of as a major goal of the 
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educational process. A number of educators have argued that school Ing should 
not present students with "correct" or "acceptable" ideas, but Instead should 
devel op students’ reasoning skIIIs so they may critically choose which Ideas to 
accept on thelr awn (e.g., Scheffler, 1973). Our disclpline's support of 
discussion and debate activities reflects commitment to this second educational 
goal. 

This review of the questioning literature Is motivated by three 
objectives. The first Is to present a useful conceptual ization of teacher 
questioning skIl!. Like most soclal Interaction skills, questioning skill Is 
composed of many verbal and nonverbal behaviors. A broad conceptual ization of 
questioning skill Is argued for here. Aside fram those skills Involved [n 
asking Initial questions, the paper maintains an effective questioner must al so 
master skills related to responding to student answers and asking sequences of 
questions, This tripart conceptual ization of questioning skill Is lilustrated 
In Appendix A, and serves as an organizational scheme for the reviea. 

A second objective Is to clarlfy which "behavioral skIills" have been 
val Idated as effective questioning techniques. Given the widespread bel lef 
that questioning Is an Important part of effective Instruction, It Is not 
surprising that several books (e.g., Hyman, 1979; Wilen, 1982) and articles 
(Cacha, 1981; Deethart, 1974; Nyquist & Booth, 1977) offer advice on 
questioning techniques. Additionally, a host of training programs have been 
developed to Instruct teachers In questioning techniques (e.g., Borg, 1972; 
Dangel, Conrad, & Hopkins, 1978; Good & Brophy, 1974; Otto & Schunk, 1983; 
Saunders, Fall, Nelson, & Smith, 1975; Wagner, 1973). These programs have 
util ized a varlety of training methods, Including modeling, practice with 
feedback, cognitive discriminative analysis, microteaching, and Interviews (for 
a review of the effectiveness of many of these methods see Levinson-Rose & 


Menges, 1981). 
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One problem with these articles and programs Isi that the benefits of 
specific questioning tecnniques are often assumed, not established. Educators 
and trainers have frequently assumed that If questioning Is an Important part 
of effective Instruction, specific questioning techniques which are popular 
must be beneficial. The result Is that many programs Instruct teachers to use 
questioning "skills" which may be Ineffective or even detrimental to student 
success. To support this clalm, research evaluating the "skiils" taught In a 
training program developed by Borg (1972) was reviewed. The Borg program was 
chosen as an example for several reasons: It Is representative of the various 
training programs; It clearly defines the techniques being trained; and It 
trains a varlety of techniques. Results of this examination\ are displayed In 
Table 1. Of the elght techniques that are trained, only two héve been shown to 
have positive effects on student achievement and/or critical thinking skills. 
Two techniques appear to be unrelated to student success, and two have been 
documented as detrimental to student success. At this point It Is difficult to 
draw conclusions about the effect of one of the techniques (higher | evel 
questions), and no research has directly examined the final technique. 

The practice of Including questioning techniques In training programs 
before establ ishing thelr validity has at times even resulted In having two 
training programs Instructing educators to enact the exact opposite behaviors. 
McNeI|l and Popham (1973) explain that: 

"In some Instances teachers are learning contradictory skills 
at different Institutions. For example, the Far West 
Regional Laboratory uses a minicourse to train teachers to 
repeat [student's] answers less often; but the Northwest 


Regional Laboratory has a training program In Fl ander's 
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Interaction Analysis which has as one measure of preferred 

"Indirect teaching’ more repetition of pupli's answers" (p. 

229). 
There Is an obvious need to validate teacher questioning skills before | arge 
amounts of time and monetary resources are spent on tralning them. McNell and 
Popham (1973) belleve there Is "a danger that new teachers are learning 
practices which are not only Irrelevant but harmful to pupil progress" (p. 
229). Since this paper reviews research that has focused on the benef Its of 
varlous techniques, It should help determine what we know, and what we need to 
know, about questioning sklIll. 

A final objective Is to suggest thecretical explanations for why 
varlations In questioning methods may Influence students’ achievement and 
critical thinking skills. Dillon (1982) notes, "In general, the educational 
literature contains | Ittle theory of questions but many presumptions about 
thelr nature, function, and effect" (p. 160). The fallure to develop 
theoretical explanations has IIimited researchers! ability to predict and 
understand why question vartati on influences achievement and critical thinking; 
moreover, It has hindered researchers ability to resolve what appear to be 
contradictory findings In some areas. Presumably, variations In questioning 
techniques have effects because they Influence the process by which students 
generate answers. Gall (1984) recently outl Ined a five step process of answer 
generation: (1) attending to the question, (2) deciphering the meaning of the 
question, (3) generating a covert answer, (4) generating an overt answer, and 
(5) revising the answer. Gall's outi ine suggests that theories drawn from a 
social cognitive or Information processing perspective may provide expl anations 
for questioning effects. Such several theorles are employed here to suggest 


tentative explanations for various questioning techniques. 
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With these three objectives In mind a critical review of research 
examining questioning behavior Is _ prezented. Research examining these 
behaviors Is grouped Into three categories: asking Initial questions, 


responding to student answers, and asking question sequences. 


Asking Initial Questions 


Initial questions are defined as the first question In a question 
sequence. If no sequence Is pursued, then each question Is an Initial 
question. A teacher leading a discussion Is IIkely to ask many Initial 
questions, but Initial questions can also be used during lecture to verify that 
students are comprehending the material belng presented (Hyman, 1979). 

While most Initial questions pertain to academic content, observational 
research has found that approximately twenty percent of the questions teachers 
ask deal with non-academic content such as procedure or discipline (Gall, 
1970). Little research has examined the effects of using questions as a 
procedural or disciplinary tool. In the realm of Initial questions about 
academic content, research has focused on two areas: different methods of 


asking questions, and different types of questions that can be asked. 


Methods of Asking Initial Questions 


While many suggestions have been offered concerning methods of asking 
Initial questions, research has addressed only two Issues: singularity and 
walt time, . 

Singularity refers to the number of questions contained In an utterance: 


an utterance containing one question Is singular, while an utterance containing 
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two or more questions IS nomsingular. An example of a non=singul ar question 
Is: 

Teacher: Let's talk about John Quincy Adams. When was he 

President, and what party did he belong to? 

Wright and Nuthall (1970) examined singularity In a correlational analysis 
between thirty teaching variables and achievement. The observers coded the 
behaviors of seventeen elementary science teachers, and then administered an 
achievement test they developed to the students (N = 296). Students’ |.Q. and 
general science knowledge were controlled. Utterances containing one question 
were positively correlated with: achievement (rc = .54), but utterances 
contalning two or more questions were negatively correlated (r = -.42 and -.43, 
respectively). In terms of Gall's (1984) model, many non-singular questions 
may be difficult to declpher, since students may be confused about exactly what 
Information Is being requested. 

A second variable pertaining to the method of asking questions Is a 
teacher's use of walt time. In an early article about this variable Rme 
(1974a) broke walt time Into two parts. Generally, walt time, can be def Ined 
as the amount of time that el apses from the end of a teacher's question to when 
a student responds; walt time, can be defined as the amount of time that 
elapses fran the end of a student's response to the teacher's response (for 
specific rules on coding see Rowe, 1974a). Although some articles have grouped 
the two types of walt time Into one variable (Honla, 1982; Tobin, 1980), there 
Is evidence that the two should be distingulshed. The two types of walt times 
have been shown to result In different outcomes (Rowe, 1974a), and trainers 
have encountered different problems In teaching them (DeTure, 1979). 


Observational research has documented that In the average cl assroam both 


types of walt time are typically less than one second (DeTure, 1979; Roe, 
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1974a; Tobin, 1980). Given this, researchers began examining the effects of 
training teachers to use longer wait time (usually about three seconds). 
Findings fran studies which have elther looked specifically at wait time, or 
have grouped the two types of walt time are presented here, while findings fran 
research focusing specifically on walt time, are presented In a subsequent 
sect lon. 

One result of the util ization of longer walt time Is that the pattern of 
classroan Interaction changes. Rave (1974a) found teachers tralned to Increase 
thelr walt time, had significantly fewer students fall to answer questions than 
thelr counterparts using shorter walt time, . Answer generation Involves 
several steps == deciphering a rjuestion's meaning, searching memory for 
relevant Information, organizing Information Into a coherent response 
(Including any necessary logical reasoning), and overtly responding -=- and 
brief walt time, may short circuit this process before It reaches compli etion. 
Rowe (1974a) also discovered positive relationships between | onger amounts of 
both types of walt time and: the amount of Inferences made fran evidence; the 
number of spontanecus student questions; and the number of responses made by 
students labelled as "slay" by thelr teacher. A more recent study (Honea, 
1982) grouped both types of walt time and found similar results. Increased 
walt time resulted In longer student responses, more spontaneous student 
questions, and more student-student Interaction. While these studies Indicate 
that the length of walt time affects student Interaction, they have not shan 
that the varlable affects student success. The exception might be Rae's 
finding that longer walt time Increases "speculative" thinking and Inferences 
made fran evidence, but she does not define these variables with sufficlent 
clarity to judge If they are similar to critical thinking skills (a more 
precise description of the latter Is contained In the dIscussion of higher 


order questions). 
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Tobin (1980) has examined the effect of longer walt time on student 
success. Combining the two types of walt time Into one variable, Tobin tralned 
elementary science teachers to use longer walt time. Tobin then had trained 
and untralned teacher presents two Identical sessions to thelr students (N = 
733). Follaving each lesson students completed an achievement test devel oped 
by the experimenter. Students taught by the longer walt time teachers did 
significantly better on the second achievement test than students taught by the 
shorter walt time teachers (the difference approached significance on the first 
test as well). 

Several questions about the effects of walt time remain unanswered, 
First, the effects of walt time on both student achievement and critical 
thinking skills needs clarification. Tobin's description of his dependent 
variable measure Is very brief, and It does not specify If the test was 
composed of closed, factual questions or more open ended questions requiring 
the students to use higher order cognitive processes, Hence, the research 
Indicates that use of longer walt times probably has beneficial effects, but 
the precise nature of these effects Is not known. Second, Individual 
difference variables need to be Included In future research. Past research has 
shown that longer walt time results In more student verbal Ization. This result 
may be beneficial for only some types of students. For example, several 
researchers have concluded that students with high levels of oral communication 
apprehension both prefer and perform better In classroans with low amounts of 
discussion and student Interaction (Dowallby & Schumer, 1973; McCroskey & 
Anderson, 1976; Scott & Wheeles, 1977a). McCroskey and Anderson, for Instance, 
found that both the A.C.T. and G.P.A. scores of a group of students having high 
oral communication apprehension were significantly lover than thelr la oral 


communication apprehension counterparts; however, grades of the two student 
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groups did not significantly differ In a large lecture class that al loved 
| Ittle teacher-student Interaction. The authors note that the study's | arge 
sample size (N = 709) produced a powerful test of thelr hypothesis; hence, It 
Is unlikely the fallure to detect significant grade differences In the | arge 
lecture class was due to type |! error. The authors also report that the high 
communication apprehension group had a significantly more favorable attitude 
toward mass lecture classes than did the lov apprehension group. Finally, 
researchers might examine what Is an optimal amount of walt time. While 
research suggests that too I Ittie walt time, Is problematic, It seems | Ikely 


that a teacher may also walt too long before responding to student answers. 


Different Iypes of Questions 


Factual ys. "Higher Level" Questions. A second area of research on 
Initial questions has focusea on the different types of questions teachers can 
ask. The majority of this research has examined the eftects of asking 
questions at different cognitive levels. This research has Its genesis In 
Blom et al.'s (1955) Taxonomy of Educational Objectives, a book which 
attempted to specify which cognitive processes should be focused upon by 
teachers who wanted thelr students to become critical thinkers. Bl oan''s 
taxonomy contains six hierarchical levels: knowledge (the laest level), 
comprehension, application, analysis, synthesis, and evaluation. While both 
the comprehensiveness and the hierarchical nature of the taxonamy has been 
questioned (e.g., Furst, 1981), It has had a tremendous Impact on the 
questioning | Iiterature. A variety of question hierarchies have subsequently 
been developed (see Gall, 1970, p. 709). Two of the most popular 


categorIzation schemes are Illustrated In Table 2. 


in 


Page 10 

Observational research has consistently confirmed that about sixty percent 
of the questions asked by teachers across grade level and subject matter fal | 
at the memory or factual level (Daly & Korinek, 1980; Wilen, 1982). For the 
last fifteen years scholars have Investigated the effects of asking more 
higher-order questions on student achievement and/or critical thinking skills. 
The research Is both plentiful and conf us! ng. Several reviews and 
meta-analyses of this research exist (Medley, 1979; Redfield & Rousseau, 1981; 
Winne, 1979). Therefore, this paper briefly summarizes the methods and 
conclusfons of these articies, and then provides suggestions for how future 
research might resolve what often seem to be contradictory concl usl ons. 

Winne (1979) reviews elghteen studies of the effects of differing amounts 
of higher order questions on student achievement and critical thinking skills. 
The review contains useful, In depth descriptions and criticisms of the 
methodol ogles of these studies. Studies are grouped Into two categories: 
those Winne bel feves have sufficient Internal validity that any between group 
differences can be attributed to treatment, and those without sufficient 
Internal validity. Frequent problems found In this latter category Include the 
faliure to conduct manipulation checks and the fallure to control possible 
confounding variables. Winne then conducts a voting meta-analysis. Studies 
are placed In one of three categories: those ylelding significant positive 
results (1,@., some combination of high and law level questions Is superlor to 
predominately low level questions), those ylelding significant negative 
results, and those ylelding non-significant results. The category contalning 
the largest number of studies was that of no difference, both when all the 
studies were analyzed and when only "Internally valid" studies were Included In 
the analysis. This result occurred both when test questions requiring lover or 


higher level cognitive processing served as the dependent variable. Winne does 
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note that many studies reviewed suffer fran statistical and design flavs that 
could have prevented the positive effects of higher level questions fram belng 
dl scov er ed. 

A second meta-analysis of the higher level question research was conducted 
by Redfleld and Rousseau (1981). After critiquing the voting method 
meta-analytic technique, the authors reanalyze the studies reviewed by Winne 
using an effect size statistic. The review analyses the twelve of the elghteen 
stucles fran which data necessary for the meta-analysis could be obtalned. Two 
studies completed after the Winne review were also Included. The effect size 
analysis concluded that the Inclusion of higher level questions benefited 
student performance: across the studies the results Indicated that "average" 
student would score at the 77th percentile If a member of the experimental 
group (receiving a substantial percentage of higher level questions) but would 
score at only the 50th percentile If a member of the control group. 

One question about the Redfield and Rousseau review Is the dependent 
variable that was analyzed, Most of the studies Included In the review 
contained ineasures of both factual recall of Information plus’ mental 
manipulation of It through higher ltevel cognitive processes. However, the 
effect size analysis focused only on "achievement" as the dependent variable. 
It Is unclear whether the authors analysed only the factual recall portion of 
the fourteen studies' posttests, or If scores on factual recall and higher 
order posttest questions were combined. If posttest measures were combined, 
different results might have been reported had they been analysed separately. 

A third review of the higher order question | Iterature Is presented by 
Mediey (1979). Medley began by collecting research which focused on the 
relationship between teaching variables and student achievement In students 


fran varylIng soclo-econamic backgrounds. Medley then used four criteria to 
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narrow the number of studies. These were: (1) The study must have measured 
long term change, not just Immediate change that occurred after treatment 
manipulation. (2) Observers In the study provided descriptions of specific 
teacher behaviors, Studies In which observers made evaluative Judgments about 
teacher behaviors were not Included. (3) Teachers used In the study were 
general Izable to the population of all elementary school teachers. (4) The 
specific teacher variable (e.g., asking higher versus lover order questions) 
accounted for at least fIfteen percent of the variance In student success. 

In Medley's judgment fourteen studies satisfy all four criteria. Fran 
these studies he draws a number of conclusions about effective styles of 
teaching students of varylng soclo-econamic classes. For students fran 
disadvantaged backgrounds Medley (1979) concludes, "Teachers who ask the most 
high=!evel and the fewest lav-level questions . . . are the ones who are the 
least effective. Teachers who use more low-level questions and fewer 
higher-level questions . . . are the most effective teachers" (p. 24). 

There are several questions that can be raised about Medley's review. 
First, the justification for only Including studies In which the Independent 
varlable accounted for fifteen percent of the variance in the dependent 
varlable could be chal | enged. Medi ey contends that he wants to concentrate 
his review on "important" relationships, but he does note that, "It was 
decided quite arbitrarily that the minimum overlap In variance should be 15 
percent . . ." (p. 19). Impro=ving a student's achievement score five percent 
might move him or her up a grade level. Including all the studies that met the 
first three criteria and that had significant relationships of any size might 
have altered the revlew's conclusion. Second, the dependent variable In the 
studies reviewed appears to be long term achievement galns (see Medley, 1979, 
ppe 16-17). The studies Medley reviewed apparently did not utIl Ize critical 
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thinking (higher order) questions In the dependent variable measures. Thus, 
the review's conclusion should be | Imited to the Important variable of student 
ach levement. 

This summary of the three reviews on higher-order questions highlights the 
seeming Inconsistencies plaguing this research area, Many of the 
Inconsistencies appear to be the product of conceptual and methodol ogi cal 
limitations. After reflection and study of this | Iterature, the follaving | Ist 
of suggestions for future research was compiled: 

(1) Inclusion of Appropriate Dependent Jariable Measures. One 
hypothesized effect of asking students higher level questions about academic 
content Is that they will develop and Imprwe thelr higher level cognitive 
processes from the practice of answering such questions. This analysis polnt 
to two problems with dependent variable measures in prevlous research. One 
problem Is the frequent use of multiple cholce (M.C.) questions to asses higher 
order cognitive processe:;. Students who had answered higher level questions 
might be expected to perform no differently than students who had answered 
factual questions on a factual, memory level achievement test (e.g., a MC. 
exam); however, the first group of students might be expected to perform better 
than the second on a test (e.g., an essay exam) requiring mental manipul ation 
of Information through higher order cognitive processes. Of the fifteen 
studies reviewed by Winne that Included critical thinking as a dependent 
variable, nine asked only M.C. posttest questions, Since higher order 
questions fram the "synthesize" and "evaluation" levels do not have correct 
answers, M.C. questions are an Inappropriate method of testing this dependent 
variable (Sanders, 1966). Gal! (1970) argues dependent variable measures 
should Include both MC. and short answer questions, and suggests several 
qual Itative criteria for assessing the strength of student responses to short 


answer quest Ions. | 
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A second problem Is the frequent failure to differentiate between higher 
order posttest questions tapping the same academic content covered In the 
classroan discussion versus higher order posttest questions tapping compl etely 
new content. Andre (1979) reviews evidence that the effect of higher | evel 
questions within written prose Is | Imited to the specific topic covered within 
the prose. While some ‘have suggested that repeated practice In answering 
higher level questions on various topics should Improve students general higher 
order cognitive processes (e.g., critical thinking skills), the | Imited 
training perlod In most studies (see devel opmental teaching sequence section) 
provides additional reasons for suggesting that the benefits of higher order 
questions may be IImited to mentally manipulating Information prev lously 
covered In discussion. The possibility that higher level questions’ Impact on 
critical thinking skills may be less general than previously supposed should 
not be Interpreted as suggesting such effects are Inconsequential. Andre 
(1979) explains that when a teacher assigns or asks questions about a passage 
of reading, rote memorization of the Ideas contained Is seldom the only 
Instructional goal; rather, understanding and evaluating the principles or 
concepts underlying the Idea, and the appl Icab!| Ity of such concepts to future 
sltuations that could be encountered, are also Important goals. To summarize 
this second problem, posttest measures should differentiate between the two 
types of higher order questions, and reviews should consider the two potential 
effects of higher order questions (topic specific vs. general) separately. 

(2) Utilization of Appropriate Category Coding. Rosenshine (1979) posits 
that many of the questions coded In pest research as higher level do not 
require higher order cognitive processing. Questions that do not require 
students to cognitively manipulate Information, such as simple questions of 


opinion, may not Improve students scores on either M.C. or short answer 
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posttests. Saunders et al. (1975) suggests coding questions Into three 
categories: memory level, higher level, and personal opinion. 

(3) Utilization of Appropriate Design Construction. The majority of the 
studies reviewed In the Winne (1979) and Redfield and Rousseau (1981) 
meta-analyses suffer from one of two design flaws: the fallure to use a 
pretest, or the Inappropriate analysis of change scores. Ten of the 18 studies 
rev leved by the two meta-analyses administered no pretest to subjects, but used 
only a treatment -- posttest design. This practice Is especially problematic 
for the severs! studies which made no attempt to randomly assign subjects, 
simply using Intact classes as treatment and control groups. In these studies 
It Is Impossible to determine If between-group differences are due to the 
treatment or Initial differences In ablilty levels of the classes. Even the 
studies which made some attenpt to assign subjects to treatment and control 
randomly could be strengthened by administering pretests as an additional 
control of any Initial between group differences, 

Of the elght studies that did administer a pretest, three analysed change 
scores (pretest-posttest) with an ANOVA design. This design would be 
appropriate If there were not a correlation between subjects' change scores and 
thelr pretest scores; havever, In the behavioral sclences these two scores are 
almost always significantly correlated (Cohen & Cohen, 1975). Thus, a 
subject's change score In these studies reflected not only the treatment, but 
to an unknown degree also how she performed on the pretest. The procedure 
tends to overcorrect for the effects of pretest scores; consequently, If two 
persons benef Ited an equal amount fram treatment, the person who scored highest 
on the pretest would recelve a lower change score than her counterpart. The 
concl uslons of these three studies are therefore questionable. The solution to 


this problem Is to analyze posttest scores as the dependent variable [In an 
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analysis of covariance or partiai variance design (Cohen & Cohen, 1975). The 
level of questions would be the Independent variable, and pretest scores would 
serve as a covariate. This design partials out the effect of a subject's 
Initial ability (pretest score) In an appropriate fashion. 

(4) Documentation of Question-answer Congruence. Winne (1979) proposes 
that studies need to verify that a higher order question results In students! 
using a higher order cognitive process to answer the question. Results of a 
study conducted by Mills, Berliner, Rice, and Rosseau (1980) supports this 
position. The researchers trained 54 elementary and Junior high teachers In 
one of three classification systems. They then taped discussions led by the 
teachers, measuring the match between the level of each question and answer. 
For all three systems the percentage of questlion-answer correspondence was just 
over 50%. Hence, In many studies higher order questions may not be resul ting 
In students’ using higher order cognitive processes and therefore not Improv Ing 
these critical thinking skills. MIilis et al. make two suggestions for how 
future research might Improve the degree of questlon-answer level congruence: 
train teachers to give verbal cues so that students know what level the 
question Is, and train students to classify questions so they understand the 
varfous cognitive processes, 

(5) Utilization of Developmental Ieaching Sequence. Studies of higher 
order questions have teachers begin asking all levels of questions 
Simul taneously. Such a practice may at times overload or confuse students, and 
result In the frustration of being unable to answer questions. Wright and 
Nuthall report a positive correlation (rf = .45) between the percentage of 
questions students answer and achievement. It Is suggested that this may be a 
problem with past research for two reasons. First, the vast majority of 


research on higher level questions has been conducted with elementary students, 
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Since many of the cognitive abilities necessary to answer higher |evel 
questions such as role taking or moral judgment (see Damon, 1983) devel op with 
age, simultaneously Introducing six or seven types of critical thinking might 
be especially confusing to younger students. Second, the manipulation or 
training pertod of many studies Is quite short. Five of the 18 studies In the 
two meta-analyses had teachers ask higher level questions for only one perlod 
before assessing effects, providing students with an extremely | Imited amount 
of time to practice answering the variety of higher order questions. Future 
research might have teachers move up the hierarchy of questions sequential ly 
over a number of lessons, teachers might begin by asking memory and transl ation 
questions for two or three lessons. Using Sanders (1966) classification system 
as an example, teachers might begin by asking memory and transi ation questions 
for two or three lessons, and then add each level sequentially oer 
approximately the same perlod of time. 

(6) Analysis of Individual-difference VYarlables. Future research needs 
to Include Individual difference variables. Past research has rarely examined 
Individual student differences; only four of the elghteen studies In the Winne 
review Included such variables (two Included sex, one Incl uded age, and one 
Included urban vs. rural background). One variable that could be Included In 
future research Is students! soclo-econanic status. Medley (1979) reviewed a 
number of studies focusing on various Instructlonal communication variables and 
found that 62% of the variables that Improved the success of low SES students 
were detrimental to high SES students. A second variable could be 
communication apprehension. Higher level questions usually require longer 
answers, and a number of studies reviewed earl ler conclude students high In 
communication apprehension were significantly more successful In cl assroans 
with limited student verbal ization. Inclusion of these variables In future 


research might uncover differences masked by past research. 
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(7) Presence of Iheoretically Guided Research. The final suggestion Is 
that future research be conducted fran within a theoretical perspective. The 
presence of a theoretical perspective provides no guarantee of a resol ution of 
seemingly Inconsistent research results, but the absence of such a perspective 
leaves researchers few tools to clarify such fIndings. Researchers have 
Supposed that variations In question type have effects because such varlations 
produce differences in students’ answer generation process; variation In 
questions! cognitive level most directly effects the methods students use to 
process and thereby remember the questions’ content (step 3 In Gall's model). 
Consequently, Craik and his associates’ (Cralk, 1977; Cralk & Lockhart, 1972; 
Cermak & Craik, 1979) "leals of processing" model of memory could provide one 
useful perspective for Interpreting and clarifying the results of the 
higher-order questioning | Iterature. 

In the theory's original formul ation, Cralk and Lockhart (1972) reject a 
two-store model of memory (short term and |ong term stores) In favor of a model 
conceptual IzIng Information processing as occurring In a serles of stages or 
levels. "This conception of a series or hlerarchy of processing stages Is 
often referred to as 'depth of processing’ whereas greater 'depth' Impl les a 
greater degree of semantic and cognitive processing" (Craik & Lockhart, 1972, 
pe 675). The theory posits that deeper levels of processing will result In 
"more elaborate, longer lasting, and stronger [memory] traces" (Cralk & 
Lockhart, ps 675). 

The levels of processing model Is relevant to the questloning | Iterature 
because different level questions require students to processes content at 
varying cognitive depths In order to produce a covert response. Andre (1979) 
explains that "Factual questions are bel leved to Involve less compl ex cognitive 


processing than questions requiring more than direct memory" (p. 282), and 
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notes that educators' bellef In the necessity of asking questions fran 
different levels Is grounded In the bel lef that "processing more-or-less deeply 
for meaning will produce differential effects on learning and retention" (p. 
281). 

Andre argues that although the model has received considerable empirical 
support, most studies have utI| [ized methods containing Important differences 
from the context of cl assroan questioning (p. 281). Fortunately, a few studies 
(e.g-, Paris, 1975, study 2) provide support for the model's appli Icabll Ity to 
this domain, Paris had 96 elementary students (16 fram each kindergarten to 
fifth grade) read story paragraphs, respond to elght questions about each 
paragraph, participate In a ten minute distraction task, and then complete a 
free recall measure about the paragraphs. Four of the elght questions were at 
rote memory level (e.g., Was Linda's doll new?), while four Inquired about 
Inferential relationships (e.g., Inferring necessary preconditions to make the 
paragraph true; Inferring possible consequences of actions In the paragraph; 
etc.) The data were analysed via hierarchical regression, entering grade | evel 
at step 1 and the number of correct scores on Inferential questions at step 2. 
The results Indicate that answering Inferential questions correctly accounted 
for 11% of the various In free recall scores after the effect of grade | evel 
had been statistically controlled. Interpreted within the levels of processing 
vlewpoInt, the study supports the contention that deeper cognitive processing 
of questions significantly Improves later recall of question content. 

One factor making the levels of processing framework attractive as a 
theoretical perspective Is that the model provides stralghtforward rationales 
for many Inconsistencies In the questioning | Iterature, First, superlor 
retention of deeply-processed Information occurs only If the retrieval context 


(i.e, the examination or posttest) Is similar [In nature to the |earning 
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situation (1.@., the classroom discussion) (Craik & Lockhart, 1972, p. 678; 
Jacoby & Cralk, 1979, p. 7). A discussion Including 80% higher level questions 
would therefore be expected to produce superltor posttest scores In comparlson 
to a discussion Imolving 20% higher order questions only If the posttest 
consisted of predominantly higher level questions. This first polnt highl Ights 
the necessity of avoiding only multiple choice posttests. Second, the model 
can account for developmental and Individual differences In the effect of 
question level. Concerning developmental differences, the depth at which 
Information Is processed Is Influenced by factors In addition to external 
stimul | (e.g, level of question asked), such as the student's level and 
organization of pre-existing topic knowledge (Craik & Lockhart, 1972; Naus et 
al., 1978; Nau & Halasz, 1979). Piaget & Inhelder (1973; Inhelder, 1969) have 
demonstrated that chil dren's retention In tasks Involving numerical and spatial 
relations, causal relations, and scientific concepts Impreve as children 
devel op more sophisticated schemes for organizing and storing such Information. 
Naus et al. (1978) explain these and similar findings can be easily 
Incor porated within the framework: "Since the depth-of-processing formul ation 
views memory as the assimilation of Incoming Information Into one's current 
knowledge base, the Impl ication Is that a child's existing semantic knowl edge 
determined In a real sense what Is remembered" (p, 228). The framework 
therefore suggests that differences between students exposed to high versus | ow 
level questions should not emerge until the students! cognitive structures and 
processes develop to the point where they can formulate covert responses to 
higher-level questions. Concerning Individual differences, the preceding 
discussion suggests children of lower SES may develop sophisticated social 
cognitive structures more slavly than their higher SES counterparts, probably 
because of differences In family Interaction. Sociol Inguistic (Berstein, 1975) 
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and constructivist (Applegate, Burke, Burleson, Del la, & KI Ine, 1985) research 
provides indirect support for the latter claim. Finally, the levels of 
processing framework provides a theoretical explanation for the difficulty 
posed by question |evel-response level Incongruencies. Winne (1979) suggests 
such Incongruencies may account for past fallure to find expected differences, 
since students must actually process a teacher's higher order question at 


deeper cognitive levels to obtain any potential benefits fran such questioning. 


Since depth of processing theorists have discussed a host of variables. 


that Influence processing level, the framework provides many possible 
directions for future research. For example, Jacoby and Cralk (1979) provide 
evidence that subjects required to make more difficult decisions process 
Information at deeper levels; question difficulty could be Investigated both 
across and within cognitive level. Additionally, Andre (1979) reviews ev idence 
that the Impact of question difficulty may be curvilinear, and Jacoby and Cralk 
(1979) hypothesize difficulty effects may Interact with source (teacher) 
credibility. Thus, the ievels of processing perspective can generate 
suggestions for where researchers could focus attention In attempts to clarify 
the higher order questioning | Iterature. 

This discussion has examined three reviews of the research of higher | evel 
questions. Several suggestions for future research are presented. However, 
questions can be classified by means other than the cognitive process necessary 
to answer them. The next portion of this paper explores three other variations 
In question type. 

Additional Types of Questiors. Three other ways that questions may be 
classified are (a) open versus closed, (b) rhetorical versus non=-rhetorical, 
and (c) answer known versus answer not known. The first of these varlables can 


be considered on a spectrum. Questions at the closed end of the spectrum have 
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one "correct" answer; questions at the open end of the spectrum have many 
possible answers which can be Suppor ted_ ty tego and evidence. Since extremely 
low level questions are closed ander enely high level questions are open, the | 
cl osed-open_d!inension Is often considered to be synonymous with the low 
. Level=high level dimenston previously mentioned. However, questions at a 
medium cognitive level can be elther closed or open. Consider the fol laing 
question: 
Teacher: 0O.K. class, why does principle X apply to this 
situation? 

If there Is one correct answer to this appl ication level question then It Is 
closed; alternatively, If there are a variety of legitimate answers the 
question Is open. It may be beneficial to distinguish these dimensions In 
future research. One effect might be more consistent results In research 
vary Ing the frequency or proportion of higher order questions. 

Coulthard (1977) reports that teachers ask few open ended questions, 
Research to date supports teacher's frequent use of closed questions. Most 
studies have found an Inverse relationship between open ended questions and 
student achievement (Rosenshine, 1979; Wright & Nuthall, 1970). Wright and 
Nuthall reports a positive correlation (cf = .46) between the percentage of 
closed questions and student achievement, and a negative relationship (rc = 
-.21) between the percentage of open questions and achlevement. One 
explanation for these results Is that students are able to answer open ended 
questions less frequently than closed questions. Since closed questions 
provide students with concrete response alternatives (e.g., yes or no), they 
seem to be easler to attempt to answer. Gall (1970) reports a strong positive 
correlation (c = .90) between these two variables, as well as a positive 


relationship (c = .45) between the percentage of questions that result In an 
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overt pupil response and achievement. Since the two variables, percentage of 
open ended questions and percentage of auestions producing a student response, 
have been found Inversely related, future research might explore If teachers 
can use techniques that help students attenpt to answer open ended questions. 

Another way In which questions can be categorized Is rhetorical vs. 
non=-rhetorical. Zillerman and Cantor (1973) have Investigated the use of 
rhetor Ical quest tons during lecture. They speculated that previous research 
had falled to find a difference between the use of rhetorical questions and the 
use of statements because subjects were maintaining a higher attention | evel 
than they would In the natural cl assroan. Using a two-factor design 
(rhetorical questions vs. statements; high vs. lo attention levels) they 
discovered that students whose Instructors used rhetorical questions did 
perform significantly better on a factual recall test In the law attention 
condI tion. 

Finally, Dillon (1982) has suggested that questions could be classified on 
the dichotomy of answer known by the teacher (non=Inquiry) versus answer not 
known by the teacher (Inquiry). Logiclans, IIngulsts, and philosophers have 
devel oped several properties common to questions of Inquiry (Dillon, 1982). 
Both the questioner (Q) and the respondent (R) assume that: (1) the Q does not 
know the answer and the R does; (2) the Q desires and needs to know the answer; 
and (3) the Q belleves the R can supply the answer. It Is apparent that In 
most cases teacher questions do not fulfill these criteria. Dillon argues that 
because of this most cl assroan questions do not develop the thinking process of 
elther the teacher or students: "., . . because teacher questions do not 
express perplexity or seek unknown Information, they serve | Ittie function In 
the teacher's own thinking, and IIkely do not stimulate hIigher=cogni tive 


processes In students . . . One Impl ication for practice, especially during 
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discussion classes, might be for the teacher to juse questions about which the 
teacher experlences perplexity" (1982, p. 160). It Is Important to recognize 
that Dillon's suggestion Is | imited to the case where the teacher's goal Is to 
develop students’ critical thinking skills (e.g, not during a review for an 
examination). Future research could examine If Inquiry questions do help 
students develop the varlety of cognitive skills reviewed In the discussion of 
questioning hlerarchlies, 

The first section of this revlew has focused on asking Initial questions, 
and varlations In both the method of asking questions and the type of questions 
asked have been explored. Section two focuses on responding to student 


answers. 


Responding to Student Answers 


A second category of questioning skills Involve responding to students! 
answers. Initially, It may seem that questioning skIl 1s should encompass only 
those skills Involved In asking questions. This paper has adopted a broader 
conceptual Ization of questioning skill for two reasons. First, responding to 
students' answers appears to be part of the structure of the questlon-answer 
sequence. Coulthard (1977) has analysed teacher=student [Interaction during 
discussfon using content analysis. He concludes there Is a_ consistent 
structure to the questlon-answer sequence. In most cases the structure Is as 
follovs: the teacher asks a question, a student answers the question, and the 
teacher responds to the student's answer (T-&T, T=-ST, .. .). Rarely does 
the structure consist of only questions and answers (T=S, T=S, . . .)- Thus, 
responding to questions Is part of the process of Instructional questioning. 


Second, responding to answers poorly may mitigate developed question asking 
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skills. For example, a teacher who asks Initial questions skillfully but 
frequently criticizes students’ answers may be no more successful than a 
teacher who asks Initial quest Ions pooriy. Mastering both types of skills may 
be necessary to become an effective questioner. 

Coulthard (1977) has also analyzed teacher responses In detall. In most 
cases teacher responses are composed of three parts: accepting (taking the 
student's answer Into the conversation, often by repeating It), evaluating 
(assessing the worth or relevance of the student's answer), and commenting 
(adding additional Information to the student's answer). The three parts are 
Illustrated In the following exampl e: 

T: When did Columbus discover America? 
S: 1492 
Ts 1492 (accepting) 
That's very good Mary. (eval uating) 
It was the fall of 1492 to be exact. (commenting) 
Research on teacher responses Is therefore divided Into these three 


subcomponents. 


Accepting 


Under the category of accepting two variables have been explored. The 
first Is the length of walt time, (the amount of time before responding). 
Research on the effect of extended walt time In general has been prev Jously 
discussed, Lengthening walt time, may have both positive and negative 
consequences. Research has shavn that students whose teachers walt longer to 
respond give significantly longer answers (Rove, 1974a; Deture, 1979). Since 


Wright and Nuthall (1970) report a negative correlation (rc = -.23) between 
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extended pupil response (more than two Iines on thelr transcript) and 
achievement, It appears longer walt time, has a slightly negative effect on 
factual learning for students as a whole, However, this conclusion must be 
qual ified In two respects. First, the effect may vary with the type of 
student. Rowe (1974a) found teachers waited significantly longer for students 
they rated as bright than for students they rated as slow (3.0 sec. vs. 2.0 
sec.). When teachers were trained to walt for 3.0 seconds before responding, 
thelr expectations of slow students Increased. A number of studies have 
supported the relationship between teacher expectations and student achievement 
(see Scott & Wheeles, 1977b). Second, the effect may vary with the dependent 
variable of Interest. Longer student responses may be Inversely related to 
factual achievement, but future research might explore thelr effect on crit'cal 
thinking skills as well. 

The second variable under this category Is repetition of students! 
responses, Coulthard (1977) notes this Is a common technique used to Indicate 
recognition of a students' answer, as well as to pass the answer on to the 
students who may not have heard It. Different training programs have ad Ised 
teachers both to repeat and not to repeat students's answers (McNel|l & Pophan, 
1973). The only study examining repetition of students’ answers concluded It 
was not correlated with achievement (Wright & Nuthall, 1970). Rave (1974b) 
Indicates that breaking the habit of repeating students' responses may help 
lengthen walt time,, but It Is certalniy possible both to walt before 
responding and then to begin the response by repeating the student's answer. 
After accepting a student's answer Into the discussion, a teacher usually makes 


an evaluation of It. 
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fvaluating 


Coul thard (1977) describes evaluating as assessing the worth or relevance 
of a student's answer. One type of evaluation a teacher can provide Is 
feedback. In this paper, feedback Is defined as a statement which explains If, 
and In some cases why, the student's answer Is correct or Incorrect. Brophy 
(1981) explains the Importance of providing students with feedback. "Al most 
100 years of research has establ Ished that knowledge of results facil Itates 
learning, and usually Is essential to It" (p. 6). Little research has examined 
effective styles of providing feedback to students’ responses, but It seems 
| Ikely that the guidelines that have been developed for giving effective 
feedback In general (e.g, specificity, timel Iness, etc.) would apply (e.g, 
Crable, 1981). Teacher feedback to a student's response might also Incl ude 
Information concerning why the student produced a correct or Incorrect answer. 
The | Iterature on communication and self attribution Is relevant here (Dweck & 
Goetz, 1978; Schneider, Hastorf, & Ellsworth, 1979, chap. 5). Several studies 
have | Inked feedback to student self attribution for success or fallure and to 
student performance. For example, Dweck (1975) worked with students who 
generally expected to fall and who gave up quickly after failure. One group 
was given a month of complete success experlences; a second group was given a 
month of predominantely success experiences, but we-e Instructed to attribute 
fallure to lack of effort rather than success when they did fall. Follaving 
the training perlod students In group one quickly reverted back to their 
pattern of "learned helplessness," but students In group two continued to work 
on problems after Initial fallure. Miller, Brinkman, Bolen (1975, study 2) 
also documented the Influence of feedback on self attribution and performance. 


The researchers assigned 96 second graders to one of sIx conditions: two 
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attribution conditions, two persuasion conditions, a reinforcement cond! tion, 
and a control condition. In the attribution conditions students were told they 
were good math students by several sources (e.g., teacher, principal, etc.); In 
the persuasion conditions students were told there were many reasons they 
should become good math students (Implying a negative self attribution). 
Pretests and Immediate and del ayed posttests were administered for mathematics 
self concept and aptitude. Results revealed that only the self concept of 
students In the two. attribution conditions significantly Improved. 
Additionally, students In both attribution conditions scored significantly 
larger achievement gains than other conditions on Immediate and del ayed 
posttests. These studies suggest that self attribution framework could prov ide 
theoretical guidance for future research on feedback to students! responses. 
Since feedback that encourages attributing fallure to lack of effort has the 
potential to threaten students' "face," future research might examine If such 
feedback must also provide face-support (e.g, Applegate, 1982) to be 
ef fective. 

In addition to prow=iding students with feedback, teachers sometimes pral se 
or criticize thelr students. Brophy (1981) argues that pralse "connotes a more 
Intense or detalled teacher response than. . . [does] feedback... pralse 
statements express positive teacher effect" (pp. 5-6). Thus, the response 
"South Dakota, that's right Billy" Is feedback, whereas the response "South 
Dakota, very good Billy" Is pralse. Brophy notes that one way a teacher can 
pralse a student Is by explaining why his/her answer Is valuable. The opposite 
of pralse Is criticism -= expressing negative affect toward a student In a 
response. Teacher criticism has consIstently been found to be negatively 
related to student achievement (see Daly & Korinek, 1980), ‘though the 


correlational nature of most research prevents concluslons about the causal 
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direction of this relationship. However, findings on the effect of pralse have 
not been as consI| stent. 

Several reviews have concluded that the correlations between pralse and 
student achievement are usually weak and often In conflicting directions 
(Brophy, 1981; Dunkin & Biddle, 1974; Rosenshine & Furst, 1973). Brophy notes 
that most studies have found a weak positive correlation between the frequency 
of praise and achievement, but a nonsignificant correlation between achievement 
and the ratio of the number of good answers pralsed to the total number of good 
answers. 

Two suggestions may help clarify the relationship of teacher pralse and 
student success In future research. First, pralse needs to be measured In 
qualitative as well as quantitative terms. O'Leary and O'Leary (1977) have 
suggested three qual Ities common to ef fective pralse:: 

(1) Contingency == The pralse should be IInked to the 
behaviors the teacher wishes to reinforce (I.e., pralse 
only correct answers). 
(2) Specificity -- The pralse should Identify the specific 
behav lor/statement that Is correct/valuable, and (unless 
It Is obvious) explaln why It Is correct/val uabl e, 
(3) Credibility -- The pralse should sound sincere, and be 
bel levabie, 
Observational research Illustrates the Importance of using qual Itative 
measures. Rowe (1974b) found elementary sclence teachers gave more specific 
pralse to students they perceived as bright than to students they percelved as 
sl OW. Similarly, Dweck and Goetz (1978) review evidence that although the 
amount and type of pralse or criticism given to mastery orlented and | earned 


helpless students does not differ, the messages teachers direct at mastery 
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orfented students focus on much more specific aspects of thelr performance. 
This research suggest that qual Itative measures of pralse may correlate more 
strongly with achievement. 

Second, Individual difference varlabi es need to be examined. For example, 
Brophy (1961) has suggested that vague pralse may be beneficial for younger 
students, since they may not be able to differentiate between specific and 
non-specific pralse. However, older students, whose social cognitive 
structures and processes are much more devel oped, may make the attribution that 
the teacher bel leves they are dumb If the pralse Is not specific or credible. 
Additionally, both Brophy (1981) and Medi ey (1979) review evidence that pralse 
has differing effects on students of differing SES. 


Comment ing 


After evaluating a student's response It Is not uncommon for teachers to 
provide additional Information about the topic of discussion. A | Imited amount 
of research has directly examined this part of a teacher's response. Wright 
and Nuthall (1970) found the frequency teachers provided "reflective" comments 
following pupI| answers was not significantly related to achievement. Medi ey 
(1979) concludes that the teachers who are the most successful with students 
fran low SES backgrounds are those who do not expand upon pupl! comments. One 
possibility Is that the effects of commenting Is determined by the function It 
serves, Informative summaries at the end of topical units have been positively 
related to achlevement (Mediey, 1979; Wright & Nuthall, 1970); comments which 
summarize matertal before moving on to new “toples might also be beneficial. 
However, comments which deter fram class materlal and prevent student-teacher 


Interaction are most | Ikely to be detrimental In effect. 
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The second section of this paper has examined research on the three parts 
of teachers! response behavior: accepting, evaluating, and commenting. After 
a teacher asks an Initial question and responds to a student's answer, one 
option he/she has Is to pursue a sequence of questions. The final section of 


this paper examines research focusing on question sequences, 


ASKING SEQUENCES OF QUESTIONS 


Education scholars have often mentioned the Importance of question 
sequences. Over fifteen years ago Gall (1970) encouraged scholars to focus on 
question sequences. Arkowltz (1981) explains the Importance of examining 
sequences of behavior when assessing social skills such as questioning: ".. . 
simple frequency counts may obscure some very Important Issues relating to the 
timing, sequencing, and context of behaviors: Issues which may determine the 
adequacy or skillfulness of behavior" (p. 302). Wilen (1982) draws a similar 
conclusion when he writes that "without a strategy, a discusslon can become a 
serles of questions | acking coheslon and purposeful sequence" (p. 9-10). 

Two types of question sequences have been discussed In past research. The 
first Is the redirect sequence -- the teacher asks one question to several 
students before moving on to the next question. Hyman (1979) argues this 
strategy should enhance group participation and attention. Hyman (1977) 
observed teachers In the classroan and found that about ninety percent of the 
question sequences used were redirect sequences, Several studies have examined 
the effect of redirects on student achievement. Wright and Nuthall found a 
positive correlation (rc = .54) between the use of redirects and achievement. 

Two studies have manipulated the use of redirects. Gall, Ward, Berliner, 


Cahen, Winne, Elashoff, and Stanton (1978) found no significant difference 
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between student achievement and critical thinking skills for students whose 
teachers used redirects and those who did not. Riley (1981) found that the 
effect of redirects depended on the type of posttest question. Students who 
teachers used redirects performed significantly better on knowledge questions, 
but did not significantly differ fram the no redirect group on comprehension or 
analysis questions, Future research might evaluate the effect of a redirect 
sequence on the cognitive activities required to answer questions fram all 
levels of Bloan's taxonany. 

The second type of question sequence Is the probe or follav-up sequence. 
Fol lav-up questions can serve several functions, such as to clarify a student's 
response, request additional Information fran a student, or request a student 
to justify or explaln how s/he reached a conclusion (Nyquist & Booth, 1977). 
Research has falled to | Ink the use of follav-up questions to achievement gains 
(Gall et. al., 1978; Wright & Nuthall, 1970). Future research could address 
several questions. First, follav-up questions might be divided by function to 
determine If some types are effective In specific situations while others are 
not. Additionally, the effect of follow-up questions on critical thinking 
skil 1s might be studied, Hyman (1977) argues that by starting at lam level 
questions and progressing to higher level questions folla-up sequences could 


be used to develop students! cognitive skills. 


CONCLUSION 


This paper has presented a conceptual ization of the behaviors that compose 
the process of teacher questioning. Section one described different methods of 
asking Initial questions and different types of questions that can be asked, 
Section two discussed the three components of a teacher's response to a 


student's answer; the final section examined question sequences, 
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The paper hopes to serve three functions. First, the conceptual Ization of 


teacher questioning skills should prwide a clearer Idea of the specific 
teacher behaviors Involved In the process of questioning and how these 
behaviors relate to one another. Second, the review should clarify which 
behavioral "skills" have establ Ished val Idity. In the Introduction It was 
argued that educators and trainers often Instruct teachers to utilize 
questioning fechnlaues which are In vogue, without carefully examining the 
evidence for the techniques. Many tralning programs have Instructed teahers to 
use techniques which are probably unrelated or even detrimental to student 
success: "Much effort has been wasted In training teachers to behave In the 
ways that the least effective ones do" (Mediey, 1979, p. 26). The review 
highl Ights which behaviors have been established as beneficial. When 
val Idational evidence was Inconsistent, the paper provided suggestions for 
future research exploring In what types of situations, for what types of 
educational objectives, and with what types of students the technique might be 
beneficial. Finally, In several Instances the review suggested theoretical 
frameworks that could gulde such future research on questloning strategles. 
Communication scholars are In an excellent position to begin val Idational 
work on specific questioning techniques. Galvin and Cooper (1981) concur that 
process varlables such as questioning "are at the very heart of teaching and 
are, perhaps, where our communication education researchers! efforts should be 
focused" (p. 57). If In the future a number of specific questioning techniques 
are validated, the positive effect on students' achievement and critical 


thinking skIil Is could Indeed be significant. 
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Notes 


‘This first suggestion also Impl icitly advances an Important tenant of 
question asking: the Instructor should adapt the question level, as well as 
the type of test question, to the specific desired Instructiona! goal. 
Memorization and critical synthesis or evaluation of topical material are 
different Instructional goals which necessitate adaptation of both cl assroa 
and examination question level. 


2 One frequent criticism of the levels of processing model Is the 
difficulty of determining an Index of processing depth Independent of 
recognition or recall level. "Material that Is deeply processed Is predicted 
to be remembered effectively, but that which has been remembered Is also 
alleged to have been procedded to a deep level. Both (presumed) degree of 
processing and recall are obtained fran the same data" (Naus, Orensetin, 
Hoving, 1978, p. 223). To avold this circularity an Independent criteria of 
processing depth must be specified prior to hypothesis testing. In the area of 
classroan questioning the cognitive level of a teacher's question or students’ 
overt responses could serve as an Independent criteria. The search for such 
criterla has resulted In reformul ations of the original theory; for example, 
depth Is naw often cocelved as a multidimensional construct rather than a 
single continuum (e.g., Jacoby & Craik, 1979; Naus et al., 1978). 
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TABLE 1 
REVIEW OF EVIDENCE CONCERNING SKILL VALID!TY OF BORG (1972) PROGRAM 


Description of Skill Evidence of Validity {to date) 


1. Redirecting the same Weight & Nuthall (1970): Positive 
question to several positively correl ated with 
students ach levement (r= .54) 

Gall et ala (1978): 

mani pul ated redirects 
(yes/no); no sig. 
differences between 

groups 

Riley (1981): mantipul ated 
redirects; sig. difference 
for 1 cf 3 types of 
questlons 


2. Framing questions Weight & Nuthal (1970): Negative 
that require | onger longer student responses 
answers negatively correl ated 
with achievement (r = -.23) 


3. Framing questions Weight & Nuthall (1970): Negative 

that avoid yes/no percentage of cl osed 

repli les (cl osed) questions positively 
correlated with achievement 
(r = .46); percentage 
of open questions negatively 
correl ated with achievement 
(r = =.23) 
Rosenshine (1979): 
frequency of open questions 
negatively correl ated with 
ach levement 


4. Framing questions Winne (1979): reviews 18 Not yet 
that require puplis studies, concluded no effect establ Ished 
to use higher on achievement or critical 
cognitive processes thinking skills 

& Bosseay (1981): 
revlews 14 studies, concl uded 
positively related to student 
success 
Medley (1979): concluded 
negatively related to 
achievement for students 
of lover SES status 


4y 


5.  Pranpting students/ 
seeking pupil 
cl arif ication and 
Insight 


6. Teacher shouldn't 
repeat his/her own 
questl ons 


Ve Teacher shoul dn't 
answer his/her avn 
questions 


8. Teacher shoul dn't 
repeat pupI| answers 


*ThIs program was devel oped by the Far West Reglonal Education Laboratory. 
Educational 


it was reported by W. R. 
63, 572-579 (see table 1 
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& Nuthali (1970): Unrel ated 
not sig. correlated with 
ach levement 
Gall et al, (1978): 
manipul ated (yes/no), no 
sig. differences between 


groups 
No on point research Not yet 
establ Ished 

Wright & Nuthall (1970): Positive 
percentage of questions 
answered by students 
positively correl ated 
with achievement (r= .45) 

& Nuthall (1970): Unr el ated 


not sig. correlated with 
achievement (r= .17 corr. 
between repeating answer 
and ach levement) 

McNell & Popham (1973): 
other programs traln 
exact opposite 


Borg (1972) In the Journal .of 
In the article). 
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TBLE 2 


SUMMARY OF TWO QLASSIFICATION SCHEMES 


Memory : 


Transl ation: 


Inter pretation; 


Appl Ication: 


Analysts: 


SynthesIs: 


Eval uation: 


sanders 11966) 
student recalls or recognizes Information. 


student changed Information Into different words or a 
different code (e.g., put In avn words). 


student discovers the relationship among facts, values, 
and/or skills. 


student solves a IIfelike problem that requires 
Identification of an issue and selection of the relevant 
knowl edge/skil ls. 


student solves a problem by demonstrating knowledge of 
parts of a problem and/or different ways of thinking 
about the problem. 


student solves a problem that requires orlginal/creative 
thinking. 


student makes a judgment of good=--bad or right--wrong 
using standards/criteria he/she chooses. 


Gallagher & Aschner (1965) 


Cognitive memory: student reproduces Information fran memory. 


Convergent thinking: student analyzes/Integrates Information he/she Is 


given or has memorized; characterized by highly 
structured (closed) questions. 


Divergent thinking: student uses own Ideas to provide the Information 


needed to answer the question; characterized by less 
structured (open) questions. 


Eval uative thinkIng: student makes Judgments of value, morais, or worth; 


characterized by less structured (open) questions. 


APPENDIX 


A CONCEPTUALIZATION OF TEACHER QUESTIONING SKILLS 


Teacher Questioning Skills 
Asking Initial Responding to Asking Question 
Questions Student Answers Sequences 
Non-academic Academic Accepting Evaluating Commenting 
Content Content 


Methods of Differing 
Asking Types of 
Questions Questions 


Singularity Higher Level/ Wait Time, Feedback 
Lower Level 


Fol low-up 
P Sequence 
Wait Time, Repitition Praise 
Open/Closed of Pupil's 
Response Criticism 


Redirect 
Sequence 


Rhetorical / 
Non- 
Rhetorical 


Inquiry/ 
Non-Inquiry 


4" 


